Multimedia system having an adaptive multimedia controller

ABSTRACT

An adaptive multimedia system includes a display, an audio device, and an adaptive media controller configured to selectively communicate with a media source and selectively signal the media source to stream only a desired portion of a media stream.

BACKGROUND

The present invention relates to the art of multimedia systems and, moreparticularly, to a multimedia system having an adaptive multimediacontroller that adjusts media streams based on client events.

Currently, many individuals stream multimedia data through an Internetconnection to a multimedia system. The Internet connection may beestablished through a variety of providers including cable, satellite,and mobile device providers. The multimedia system may include adisplay, an audio device, and the like. For example, the multimediadevice may be embodied in a smartphone, a computer monitor, a tablet, alaptop computer, or a television. The multimedia data is typicallyprovided in one or more streams including a video stream and an audiostream. Often times, only one stream may be desired. For example, a usermay want to perceive only an audio portion of a media stream, or only avideo portion of a media stream. Thus, there may not be a need to streamall data associated with a particular media stream.

SUMMARY

According to an embodiment of the present invention, an adaptivemultimedia system includes a display, an audio device, and an adaptivemedia controller configured to selectively communicate with a mediasource and selectively signal the media source to stream only a desiredportion of a media stream.

According to another embodiment of the present invention, a computerimplemented method of selectively adapting a media stream to amultimedia system includes receiving, by the multimedia system, a mediastream from a content provider, detecting an event associated with themultimedia system, transmitting, by a processor, a control signal to thecontent provider specifying at least one undesirable portion of themedia stream, receiving, at the multimedia system, a modified mediastream that consists of desirable portions of the media stream.

According to yet another embodiment of the present invention, a computerprogram product for selectively adapting a media stream to a multimediasystem includes a computer readable storage medium having computerreadable program instructions embodied therewith. The programinstructions are executable by a processor to perform a method includingreceiving, at the multimedia system, a media stream from a contentprovider to the multimedia system, detecting an event associated withthe multimedia system, transmitting, by a processor, a control signal tothe content provider specifying at least one undesirable portion of themedia stream, and receiving, at the multimedia system, a modified mediastream that consists of desirable portions of the media stream.

BRIEF DESCRIPTION OF THE DRAWINGS

The subject matter which is regarded as the invention is particularlypointed out and distinctly claimed in the claims at the conclusion ofthe specification. The forgoing and other features, and advantages ofthe invention are apparent from the following detailed description takenin conjunction with the accompanying drawings in which:

FIG. 1 depicts a multimedia system including an adaptive mediacontroller, in accordance with an exemplary embodiment;

FIG. 2 is a block diagram depicting the adaptive media controller, inaccordance with an aspect of an exemplary embodiment; and

FIG. 3 is a flow diagram depicting a method of selectively adapting amedia stream to the multimedia system of FIG. 1, in accordance with anaspect of an exemplary embodiment.

DETAILED DESCRIPTION

With reference to FIG. 1, an adaptive multimedia system, in accordancewith an aspect of an exemplary embodiment, is indicated generally at 2.Adaptive multimedia system 2 is shown in the form of a laptop computer4. However, it should be understood that adaptive multimedia system 2may take on a variety of forms including portable devices such assmartphones, tablets, and the like as well as less portable devices suchas desktop computer systems, televisions, entertainment systems, and thelike. Adaptive multimedia system 2 includes a housing 6 that may supporta display 8. In the exemplary aspect shown, display 8 is supported tohousing 6 through a hinge 10. It should be realized that display 8 mayalso be remote from housing 6 and connected through a wired and/orwireless connection. Further, it should be understood that display 8could be built into housing 6 without the need for a hinge.

Adaptive multimedia system 2 may also include an audio device 12 thatcould take the form of a speaker (not separately labeled) or provide aconnection, through for example, a headphone jack, wirelesscommunication or the like, to an audio device. Additionally, adaptivemultimedia system 2 may include a keyboard 14 that provides a userinterface. Of course, other forms of user interfaces, such as remotecontrol devices, soft or virtual keyboards, and the like may also beemployed.

In accordance with an aspect of an exemplary embodiment, adaptivemultimedia system 2 includes an adaptive media controller 20 which, aswill be detailed more fully below, selectively controls media streamsbased on one or more events. As shown in FIG. 2, adaptive mediacontroller 20 may include a central processing unit (CPU) 30 operativelyassociated with a non-volatile memory 32 which may store a set ofcomputer implemented instructions for controlling media streams. Ofcourse, it should be understood, that adaptive media controller 20 maybe built into other components of adaptive multimedia system 2.

In accordance with an aspect of an exemplary embodiment, adaptive mediacontroller 20 may also be operatively connected to one or more eventsensors 38. Event sensors 38 may include a display sensor 40 that maydetermine whether display 8 is active. For example, display sensor 40may detect an application of power to display 8. Display sensor 40 couldbe built into hinge 10 or form part of an overall control system formultimedia system 2. Event sensors 38 may also include an audio sensor42 that may determine whether audio device 12 is active. For example,audio sensor 42 may determine whether a mute feature is activated,either through a hardware device, such as keyboard 14, or through asoftware application.

Adaptive multimedia system 2 may also include one or more user sensors44 that may detect user related parameters. For example, user sensor 44may take the form of a proximity sensor to determine whether a user ispresent at display 8; or an eye gaze detector that may determine whethera user is watching display 8. Further, user sensor 44 may take the formof a camera 48 associated with multimedia system 2. Camera 48 maycapture images of a user(s) for analysis by one or more algorithms (notshown) to determine presence, eye gaze, or other parameters that maydetermine whether the user is focused on visual content on display 8.Adaptive media controller 20 may rely on one or more inputs from eventsensors 38 and/or user sensor(s) 44 to tailor a media stream transmittedto multimedia system 2 from a media source 60 to user circumstances,and/or preferences, as will be detailed more fully below.

Reference will now follow to FIG. 3 in describing a method 70 ofselectively adapting a media stream to multimedia system 2. In block 80,a media stream is received from media source 60. In block 82, adetermination is made whether an event is detected. If an event hasoccurred, in block 84 an event type determination is made. For example,a determination is made whether the event is an audio related eventand/or a video or display related event.

If an audio event is detected in block 84, adaptive media controller 20may signal media source 60 to transmit one or more replacementparameters, such as a signal to replace an audio portion of a mediastream with a highly compressible replacement audio stream portion inblock 86. For example, adaptive media controller 20 may send a controlsignal to media source 60 requesting that audio portion of the mediastream be replaced by a highly compressible audio signal. In accordancewith an aspect of an exemplary embodiment, if audio device 12 is muted,a highly compressible audio stream may be matched to audio device 12.For example, if audio device 12 has a frequency range of 100 Hz-10,000Hz, the adaptive media controller 20 may send a control signalrequesting a highly compressible audio signal, which may embody a toneof 5 Hz, be transmitted to multimedia system 2. In this case, a tone of5 Hz would be outside the frequency response capability of audio device12 and thus could not be produced. Alternatively, the highlycompressible audio tone could be a uniform tone at a frequency notdetectable by a human ear.

If a video event is detected in block 84, such as an interruption ofpower to display 8, adaptive media controller 20 may signal media source60 to transmit one or more replacement parameters, such as a signal toreplace a video portion of a media stream with a highly compressiblereplacement video portion in block 88. For example, adaptive mediacontroller 20 may send a control signal to media source 60 requestingthat the video portion of the stream be replaced by a highlycompressible video signal. In accordance with an aspect of an exemplaryembodiment, the highly compressible video signal may embody a uniformvideo signal, such as a color. In accordance with an aspect of anexemplary embodiment, adaptive media controller 20 may send a controlsignal to media source 60 requesting that the video portion of thestream be replace by a black screen signal.

In either case, bandwidth requirements for the media stream may begreatly reduced without detracting from an overall user experience. Morespecifically, undesirable portions of a media stream may be replaced bya highly compressible signal to enhance an overall perception of thedesirable portion of the media stream. Further, if a subsequent event isdetected, for example, audio device 12 is unmuted, or power is restoredto display 8, adaptive media controller 20 may send a control signal tomedia source 60 to resume the full stream. That is, the highlycompressible portion of the stream may be replaced with originalportions of the stream.

At this point, it should be understood that the exemplary embodimentsdescribe a system for tailoring bandwidth of a streaming signal to userrequirements, circumstances, and the like. By replacing undesirableportions of a media stream with a highly compressible signal, bandwidthmay be reduced which could result in a cost savings depending uponavailable media plans. Further, the reduction in bandwidth requirementswould reduce and/or eliminate buffering issues that could occur whenstreaming data intensive media streams through a slow internetconnection.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the invention. Asused herein, the singular forms “a”, “an” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprises”and/or “comprising,” when used in this specification, specify thepresence of stated features, integers, steps, operations, elements,and/or components, but do not preclude the presence or addition of oneor more other features, integers, steps, operations, element components,and/or groups thereof.

The corresponding structures, materials, acts, and equivalents of allmeans or step plus function elements in the claims below are intended toinclude any structure, material, or act for performing the function incombination with other claimed elements as specifically claimed. Thedescription of the present invention has been presented for purposes ofillustration and description, but is not intended to be exhaustive orlimited to the invention in the form disclosed. Many modifications andvariations will be apparent to those of ordinary skill in the artwithout departing from the scope and spirit of the invention. Theembodiment was chosen and described in order to best explain theprinciples of the invention and the practical application, and to enableothers of ordinary skill in the art to understand the invention forvarious embodiments with various modifications as are suited to theparticular use contemplated

The flow diagrams depicted herein are just one example. There may bemany variations to this diagram or the steps (or operations) describedtherein without departing from the spirit of the invention. Forinstance, the steps may be performed in a differing order or steps maybe added, deleted or modified. All of these variations are considered apart of the claimed invention.

While the preferred embodiment to the invention had been described, itwill be understood that those skilled in the art, both now and in thefuture, may make various improvements and enhancements which fall withinthe scope of the claims which follow. These claims should be construedto maintain the proper protection for the invention first described.

The descriptions of the various embodiments of the present inventionhave been presented for purposes of illustration, but are not intendedto be exhaustive or limited to the embodiments disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the describedembodiments. The terminology used herein was chosen to best explain theprinciples of the embodiments, the practical application or technicalimprovement over technologies found in the marketplace, or to enableothers of ordinary skill in the art to understand the embodimentsdisclosed herein.

What is claimed is:
 1. A computer implemented method of selectivelyadapting a media stream to a mobile device comprising: receiving, at themobile device, a media stream sent from a content provider, wherein themobile device includes an audio device capable of outputting audio in afrequency range; detecting, by the mobile device, an event associatedwith the mobile device, wherein the detecting of the event includesdetecting, by the mobile device, a muting of the audio device; upondetecting the muting of the audio device, transmitting, by the mobiledevice, a control signal to the content provider specifying at least oneundesirable portion of the media stream, wherein the control signalrequests that replacement parameters be transmitted from the contentprovider to the mobile device for the at least one undesirable portionof the media stream, wherein transmitting the control signal from themobile device to the content provider includes the mobile deviceinstructing the content provider to substitute the at least oneundesirable portion with a high compressible audio signal that has afrequency that is outside the frequency range of the audio device; andafter the control signal is transmitted to the content provider,receiving, at the mobile device, a modified media stream that consistsof desirable portions of the media stream and the highly compressionaudio signal.
 2. The computer implemented method of claim 1, wherein thehighly compressible audio signal comprises a uniform audio signal. 3.The computer implemented method of claim 1, wherein transmitting thecontrol signal from the mobile device to the content provider includesthe mobile device instructing the content provider to replace the atleast one undesirable portion with a uniform video signal.
 4. Thecomputer implemented method of to claim 1, wherein detecting the eventassociated with the mobile device includes determining a power state ofa display and detecting the muting of the audio device.
 5. The computerimplemented method of claim 1, wherein the frequency range of audiodevice is 100 Hz to 10,000 Hz, and wherein the highly compressible audiosignal comprises a 5 Hz tone.
 6. A computer program product forselectively adapting a media stream to a mobile device, the computerprogram product comprising a non-transitory computer readable storagemedium having computer readable program instructions embodied therewith,the program instructions being executable by a processor to perform amethod comprising: receiving, at the mobile device, a media stream sentfrom a content provider, wherein the mobile device includes an audiodevice capable of outputting audio in a frequency range; detecting, bythe mobile device, an event associated with the mobile device, whereinthe detecting of the event includes detecting, by the mobile device, amuting of the audio device; upon detecting the muting of the audiodevice, transmitting, by the mobile device, a control signal to thecontent provider specifying at least one undesirable portion of themedia stream, wherein the control signal requests that replacementparameters be transmitted from the content provider to the mobile devicefor the at least one undesirable portion of the media stream, whereintransmitting the control signal from the mobile device to the contentprovider includes the mobile device instructing the content provider tosubstitute the at least one undesirable portion with a highlycompressible audio signal that has a frequency that is outside thefrequency range of the audio device; and after the control signal istransmitted to the content provider, receiving, at the mobile device, amodified media stream that consists of desirable portions of the mediastream and the highly compression audio signal.
 7. The computer programproduct of claim 6, wherein the highly compressible audio signalcomprises a uniform audio signal.
 8. The computer program product ofclaim 6, wherein transmitting the control signal from the mobile deviceto the content provider includes the mobile device instructing thecontent provider to replace the at least one undesirable portion with auniform video signal.
 9. The computer program product of claim 6,wherein detecting the event associated with the mobile device includesdetermining a power state of a display and detecting the muting of theaudio device.
 10. The computer program product of claim 6, wherein thefrequency range of audio device is 100 Hz to 10,000 Hz, and wherein thehighly compressible audio signal comprises a 5 Hz tone.